CLAIMS 

An apparatus for blind separation of an overcomplete set of mixed signals, the 
apparatus comprising: 

i. a data processing system including an input for receiving mixed signals from a 
plurality of sensors configured to receive mixed signal samples comprising a 
mixture of signals transmitted from signal sources through an environment 
and noise, a signal processor attached with the input for receiving the mixed 
signals from the sensors, and a memory for storing data during operations of 
the signal processor; the data processing system further comprising: 

ii. means for storing data representing the input from the sensors in a mixed 
signal matrix X; 

iii. means for storing data representing the noise in a noise matrix V; 

iv. means for storing data representing an estimate of the individual signals from 
the mixture of signals from the signal sources in a source signal estimate 

matrix S ; 

v. means for storing data representing an estimate of the effects of the 
environment in a estimated mixing matrix A where the matrices are related 
by X = AS + V; 

vi. means for generating an initial estimate of the estimated mixing matrix A ; 

vii. means for determining the number of signal sources and associated lines of 

correlation of each of the signal sources from the estimated mixing matrix A , 
and for representing the signal sources in the source signal estimate matrix S ; 

viii. means for jointly optimizing the source signal estimate matrix S and the 
estimated mixing matrix A in an iterative manner, to generate an optimized 

source signal estimate matrix S and a final estimated mixing matrix A ; and 

ix. means for restoring the separated source signals from the optimized source 
signal estimate matrix S , whereby a plurality of mixed signals from unknown 
sources traveling through an environment with added noise may be separated 
so that the original, separate signals may be reconstructed. 
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An apparatus for blind separation of an overcomplete set of mixed signals as set forth 
in claim 1, wherein the means for generating an initial estimate of the estimated 

A 

mixing matrix A comprises: 

i. means for transforming the mixed signal matrix X into the sparse domain 
using a transform operator; 

ii. means for determining a frequency band within the sparse domain that 
contains the most information that can be used to determine lines of 
correlation to determine the number of signal sources; 

iii. means for determining a measure and an optimal threshold for the measure for 
the determination of noise within the frequency band; 

iv. means for recalculating the measure used in the determination of the noise 
within the frequency band using the optimal threshold; and 

v. means for determining the local maxima of a distribution of the measure, 
where the local maxima represent angles which are inserted into the estimated 

mixing matrix A to provide an initial estimate of the estimated mixing matrix 

A. 

An apparatus for blind separation of an overcomplete set of mixed signals as set forth 
in claim 2, wherein the means for jointly optimizing the source signal estimate matrix 

S and the estimated mixing matrix A in an iterative manner, to generate an 

optimized source signal estimate matrix S and a final estimated mixing matrix A 
comprises: 

i. means for clustering the mixed signal samples using a geometric constraint; and 

ii. means for evaluating a convergence criteria based on the clustered mixed signal 
samples to determine whether the convergence criteria are met, and if the 
convergence criteria are not met, iteratively adjusting the clustering of the 
mixed signal samples and parameters of the geometric constraint to create a new 
set of clusters until the convergence criteria are met, to provide a final estimated 

mixing matrix A. 
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4. An apparatus for blind separation of an overcomplete set of mixed signals as set forth 
in claim 3, wherein the means for transforming the mixed signal matrix X into the 
sparse domain using a transform operator is a Fourier transform operator such that the 

estimated mixing matrix A is represented in the Fourier transform, and wherein the 
means for obtaining a multi-band sparse domain estimate of the source signal 

estimate matrix S using the relationship X = AS + V uses a wavelet transform 
operator to obtain the multi-band sparse domain estimate. 

5. An apparatus for blind separation of an overcomplete set of mixed signals as set forth 
in claim 2, wherein the means for jointly optimizing the source signal estimate matrix 

S and the estimated mixing matrix A in an iterative manner, to generate an 

optimized source signal estimate matrix S and a final estimated mixing matrix A 
further comprises: 

i. means for obtaining a multi-band sparse domain estimate of the source signal 

estimate matrix S using the relationship X = AS + V ; and 

ii. means for using the adjusted geometric constraint corresponding to the final 

estimated mixing matrix A in each of the bands of the sparse domain for the 

A. 

source signal estimate matrix S and determining whether a convergence criteria 

is met for the source signal estimate matrix S , and if the convergence criteria 
are not met, iteratively adjusting the clustering of the mixed signal samples to 
create a new set of clusters until the convergence criteria are met, to provide a 

final source signal estimate matrix S . 

6. An apparatus for blind separation of an overcomplete set of mixed signals as set forth 
in claim 5, wherein the means for transforming the mixed signal matrix X into the 
sparse domain using a transform operator is a Fourier transform operator such that the 

estimated mixing matrix A is represented in the Fourier transform, and wherein the 
means for obtaining a multi-band sparse domain estimate of the source signal 
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estimate matrix S using the relationship X = AS + V uses a wavelet transform 
operator to obtain the multi-band sparse domain estimate. 

7. An apparatus for blind separation of an overcomplete set of mixed signals as set forth 
in claim 1, wherein the means for generating an initial estimate of the estimated 

mixing matrix A comprises: 

i. means for transforming the mixed signal matrix X into the frequency domain 
using a Fourier operator; 

ii. means for using a mutual information criterion to determine a frequency band 
within the sparse domain that contains the most information that can be used 
to determine lines of correlation to determine the number of signal sources; 

jt. (band) 

iii. means for determining a random variable ang = arctan— ^ , where 

Xj(band) 

Xi(band) and xj(band) represent Fourier values of mixture in the selected 
frequency band, and an optimal threshold ANG for ang, where the optimal 
threshold ANG is determined by computing the entropy E(ang, ANG) vs. 
ANG and searching for the optimal value of ANG corresponding to the 
minimum rate of descent of the entropy E(ang, ANG); 

iv. means for recalculating ang based on the optimal threshold ANG; 

v. means for using a standard peak detection technique to determine the number 
and values of local maxima of a histogram of ang where the local maxima 
represent angles which are inserted into the estimated mixing matrix A to 
provide an initial estimate of the estimated mixing matrix A . 

8. An apparatus for blind separation of an overcomplete set of mixed signals as set forth 
in claim 7, wherein the means for jointly optimizing the source signal estimate matrix 
S and the estimated mixing matrix A in an iterative manner, to generate an 
optimized source signal estimate matrix S and a final estimated mixing matrix A 
comprises: 
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i. means for clustering the mixed signal samples in the Fourier domain along the 
lines of correlation with one cluster per source using a straight distance metric 
geometric constraint, with the clusters representing estimates of the Fourier 
domain representation of S , F(S) , where F represents a Fourier domain 
operator ; and 

ii. means for evaluating a convergence criteria, min kc T F(S) , with the 
convergence criteria, min kc T F(S) , developed from the log likelihood function 
L(F(S) | F(X), A) with the assumption of Laplanicity of source signals in the 
Fourier domain following the probability P(F(S)) = — e 1 1 , where 

c T = [1, 1, .,.1] is a unit vector, with the convergence criteria, min Xc T F(S) , 
evaluated based on the clustered mixed signal samples to determine whether the 
convergence criteria, min Xc t |f(S)| , is met, and if the convergence criteria, min 

kc T F(S)| , is not met, iteratively adjusting the clustering of the mixed signal 
samples and parameters of the geometric constraint to create a new set of 
clusters until the convergence criteria, min ^c t |f(S) , is met, to provide a final 

estimated mixing matrix A. 

An apparatus for blind separation of an overcomplete set of mixed signals as set forth 
in claim 8, wherein the means for jointly optimizing the source signal estimate matrix 

S and the estimated mixing matrix A in an iterative manner, to generate an 
optimized source signal estimate matrix S and a final estimated mixing matrix A 
further comprises: 

L means for obtaining a multi-band sparse domain estimate of the source signal 
estimate matrix S using the relationship X = AS + V , applied in the Wavelet 
domain; and 
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ii. means for using the adjusted geometric constraint corresponding to the final 
estimated mixing matrix A in each of the bands of the Wavelet domain for the 

/\ A 

source signal estimate matrix S , W(S) , and determining whether a 
convergence criteria, min lc T W(S) is met for the source signal estimate 

a T 1 * I • ■* /% 

matrix S , where the convergence criteria, min kc W(S) , is developed from 

the log likelihood function L(W(S) | W(X), A) with the assumption of 
Laplanicity of source signals in the Wavelet domain following the probability 

P(W(S)) = , where e* . p. 1, ...l]is a unit veetor, and if*. 

convergence criteria is not met, min )x T W(S) , iteratively adjusting the 
clustering of the mixed signal samples to create a new set of clusters until the 
convergence criteria, min Xc T W(S)| , is met, to provide a final source signal 

estimate matrix S . 

10. An apparatus for blind separation of an overcomplete set of mixed signals as set forth 
in claim 9, wherein the apparatus is configured for separating mixed acoustic signals. 

1 L An apparatus for blind separation of an overcomplete set of mixed signals as set forth 
in claim 9, wherein the apparatus is configured for separating mixed radio frequency 
signals. 

12. A method for blind separation of an overcomplete set of mixed signals, using a data 
processing system including an input for receiving mixed signals from a plurality of 
sensors configured to receive mixed signal samples comprising a mixture of signals 
transmitted from signal sources through an environment and noise, a signal processor 
attached with the input for receiving the mixed signals from the sensors, and a 
memory for storing data during operations of the signal processor the method 
comprising the steps of: 
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i. storing data representing the input from the sensors in a mixed signal matrix 
X; 

ii. storing data representing the noise in a noise matrix V; 

iii. storing data representing an estimate of the individual signals from the 
mixture of signals from the signal sources in a source signal estimate matrix 

S; 

iv. storing data representing an estimate of the effects of the environment in a 
estimated mixing matrix A where the matrices are related by X = AS + V ; 

v. generating an initial estimate of the estimated mixing matrix A ; 

vi. determining the number of signal sources and associated lines of correlation 
of each of the signal sources from the estimated mixing matrix A , and for 
representing the signal sources in the source signal estimate matrix S ; 

viL jointly optimizing the source signal estimate matrix S and the estimated 
mixing matrix A in an iterative manner, to generate an optimized source 
signal estimate matrix S and a final estimated mixing matrix A ; and 

viii. restoring the separated source signals from the optimized source signal 

estimate matrix S , whereby a plurality of mixed signals from unknown 
sources traveling through an environment with added noise may be separated 
so that the original, separate signals may be reconstructed. 

13. A method for blind separation of an overcomplete set of mixed signals as set forth in 
claim 12, wherein the step of generating an initial estimate of the estimated mixing 

matrix A comprises the sub-steps of: 

i. transforming the mixed signal matrix X into the sparse domain using a 
transform operator; 

ii. determining a frequency band within the sparse domain that contains the most 
information that can be used to determine lines of correlation to determine the 
number of signal sources; 
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iii. determining a measure and an optimal threshold for the measure for the 
determination of noise within the frequency band; 

iv. recalculating the measure used in the determination of the noise within the 
frequency band using the optimal threshold; and 

5 v. determining the local maxima of a distribution of the measure, where the local 

maxima represent angles which are inserted into the estimated mixing matrix 

A to provide an initial estimate of the estimated mixing matrix A . 

14. A method for blind separation of an overcomplete set of mixed signals as set forth in 
10 claim 13, wherein the step of jointly optimizing the source signal estimate matrix S 

and the estimated mixing matrix A in an iterative manner, to generate an optimized 

Q source signal estimate matrix S and a final estimated mixing matrix A comprises the 

JSJ sub-steps of: 

Nl i. clustering the mixed signal samples using a geometric constraint; and 

ijij 15 ii. evaluating a convergence criteria based on the clustered mixed signal samples to 

* w determine whether the convergence criteria are met, and if the convergence 

H criteria are not met, iteratively adjusting the clustering of the mixed signal 

jpi samples and parameters of the geometric constraint to create a new set of 
clusters until the convergence criteria are met, to provide a final estimated 

iM* 20 mixing matrix A . 

15. A method for blind separation of an overcomplete set of mixed signals as set forth in 
claim 14, wherein the step of transforming the mixed signal matrix X into the sparse 
domain using a transform operator is a Fourier transform operation such that the 

25 estimated mixing matrix A is represented in the Fourier transform, and wherein the 
step of obtaining a multi-band sparse domain estimate of the source signal estimate 

matrix S using the relationship X = AS + V uses a wavelet transform operator to 
obtain the multi-band sparse domain estimate. 



HRL073FINALc 
11/9/2001 
Page 47 of 65 



16. A method for blind separation of an overcomplete set of mixed signals as set forth in 
claim 13, wherein the wherein the step of jointly optimizing the source signal 

A A 

estimate matrix S and the estimated mixing matrix A in an iterative manner, to 
generate an optimized source signal estimate matrix S and a final estimated mixing 

matrix A further comprises the sub steps of: 

i. obtaining a multi-band sparse domain estimate of the source signal estimate 

A A A 

matrix S using the relationship X = AS + V ; and 

ii. using the adjusted geometric constraint corresponding to the final estimated 

mixing matrix A in each of the bands of the sparse domain for the source signal 
estimate matrix S and determining whether a convergence criteria is met for the 

A 

source signal estimate matrix S , and if the convergence criteria are not met, 
iteratively adjusting the clustering of the mixed signal samples to create a new 
set of clusters until the convergence criteria are met, to provide a final source 

signal estimate matrix S . 

17. A method for blind separation of an overcomplete set of mixed signals as set forth in 
claim 16, wherein the step of transforming the mixed signal matrix X into the sparse 
domain using a transform operator is a Fourier transform operation such that the 
estimated mixing matrix A is represented in the Fourier transform, and wherein the 
step of obtaining a multi-band sparse domain estimate of the source signal estimate 

matrix S using the relationship X = AS + V uses a wavelet transform operator to 
obtain the multi-band sparse domain estimate. 

18. A method for blind separation of an overcomplete set of mixed signals as set forth in 
claim 12, wherein the step of generating an initial estimate of the estimated mixing 

matrix A comprises the sub steps of: 

i. transforming the mixed signal matrix X into the frequency domain using a 
Fourier operator; 
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ii. using a mutual information criterion to determine a frequency band within the 
sparse domain that contains the most information that can be used to 
determine lines of correlation to determine the number of signal sources; 

in. determining a random variable ang = arctan x ^ an ^ ? where Xi(band) and 

Xj{band) 

xj(band) represent Fourier values of mixture in the selected frequency band, 
and an optimal threshold ANG for ang, where the optimal threshold ANG is 
determined by computing the entropy E(ang 9 ANG) vs. ANG and searching 
for the optimal value of ANG corresponding to the minimum rate of descent 
of the entropy E(ang, ANG); 

iv. recalculating ang based on the optimal threshold ANG; 

v. using a standard peak detection technique to determine the number and values 

of local maxima of a histogram of ang where the local maxima represent 

a 

angles which are inserted into the estimated mixing matrix A to provide an 
initial estimate of the estimated mixing matrix A . 



19. A method for blind separation of an overcomplete set of mixed signals as set forth in 

A 

claim 18, wherein the step of jointly optimizing the source signal estimate matrix S 
and the estimated mixing matrix A in an iterative manner, to generate an optimized 

A A 

source signal estimate matrix S and a final estimated mixing matrix A comprises the 
sub steps of: 

i. clustering the mixed signal samples in the Fourier domain along the lines of 
correlation with one cluster per source using a straight distance metric 
geometric constraint, with the clusters representing estimates of the Fourier 

domain representation of S , F(S) , where F represents a Fourier domain 
operator ; and 

ii. evaluating a convergence criteria, min )x t |f(S)| , with the convergence criteria, 



min Xc 1 



F(S) , developed from the log likelihood function L(F(S) | F(X), A) 



with the assumption of Laplanicity of source signals in the Fourier domain 
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following the probability P(F(S)) = -e - *^ , where c T = [1, 1, ...1] is a unit 

2 

vector, with the convergence criteria, min >x T F(S) , evaluated based on the 
clustered mixed signal samples to determine whether the convergence criteria, 



min Xc 1 



, is not 



F(S) , is met, and if the convergence criteria, min Xc T |F(S) 

met, iteratively adjusting the clustering of the mixed signal samples and 
parameters of the geometric constraint to create a new set of clusters until the 

convergence criteria, min Xc T F(S) , is met, to provide a final estimated mixing 
matrix A. 



10 20. A method for blind separation of an overcomplete set of mixed signals as set forth in 
claim 19, wherein the wherein the step of jointly optimizing the source signal 

estimate matrix S and the estimated mixing matrix A in an iterative manner, to 
generate an optimized source signal estimate matrix S and a final estimated mixing 
matrix A further comprises the sub steps of: 
15 i. obtaining a multi-band sparse domain estimate of the source signal estimate 

matrix S using the relationship X = AS + V , applied in the Wavelet domain; 
and 

ii. using the adjusted geometric constraint corresponding to the final estimated 
mixing matrix A in each of the bands of the Wavelet domain for the source 
20 signal estimate matrix S , W(S) , and determining whether a convergence 



25 



criteria, min >x T 



W(S) is met for the source signal estimate matrix S , where 



the convergence criteria, min Xo 1 



W(S) 



, is developed from the log likelihood 



function L(W(S) | W(X), A) with the assumption of Laplanicity of source 



si: 



gnals in the Wavelet domain following the probability P(W(S)) = — e U ' W(S) ' , 

2 



where c T = [1, 1, ...1] is a unit vector, and if the convergence criteria is not met, 
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min Xc W(S) , iteratively adjusting the clustering of the mixed signal samples 
to create a new set of clusters until the convergence criteria, min kc T | W(S)j , is 
met, to provide a final source signal estimate matrix S . 

21. A method for blind separation of an overcomplete set of mixed signals as set forth in 
claim 20, wherein the method is configured to separate mixed acoustic signals. 

22. A method for blind separation of an overcomplete set of mixed signals as set forth in 
claim 20, wherein the method is configured to separate mixed radio frequency 
signals. 



23. A computer program product for blind separation of an overcomplete set of mixed 
signals, readable on a data processing system including an input for receiving mixed 
signals from a plurality of sensors configured to receive mixed signal samples 
comprising a mixture of signals transmitted from signal sources through an 
environment and noise, a signal processor attached with the input for receiving the 
mixed signals from the sensors, and a memory for storing data during operations of 
the signal processor the computer program product comprising means, stored on a 
computer readable medium, for: 

i. storing data representing the input from the sensors in a mixed signal matrix 
X; 

ii. storing data representing the noise in a noise matrix V; 

iii. storing data representing an estimate of the individual signals from the 
mixture of signals from the signal sources in a source signal estimate matrix 

S; 

iv. storing data representing an estimate of the effects of the environment in a 
estimated mixing matrix A where the matrices are related by X = AS + V ; 

v. generating an initial estimate of the estimated mixing matrix A ; 
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vi. determining the number of signal sources and associated lines of correlation 
of each of the signal sources from the estimated mixing matrix A , and for 
representing the signal sources in the source signal estimate matrix S ; 

vii. jointly optimizing the source signal estimate matrix S and the estimated 
5 mixing matrix A in an iterative manner, to generate an optimized source 

signal estimate matrix S and a final estimated mixing matrix A ; and 

viii. restoring the separated source signals from the optimized source signal 

A. 

estimate matrix S , whereby a plurality of mixed signals from unknown 
sources traveling through an environment with added noise may be separated 
10 so that the original, separate signals may be reconstructed. 

24. A computer program product for blind separation of an overcomplete set of mixed 
signals as set forth in claim 23, wherein the means for generating an initial estimate of 
the estimated mixing matrix A comprises: 
15 i. means for transforming the mixed signal matrix X into the sparse domain 

using a transform operator; 
ii. means for determining a frequency band within the sparse domain that 
contains the most information that can be used to determine lines of 
correlation to determine the number of signal sources; 
20 iii. means for determining a measure and an optimal threshold for the measure for 

the determination of noise within the frequency band; 

iv. means for recalculating the measure used in the determination of the noise 
within the frequency band using the optimal threshold; and 

v. means for determining the local maxima of a distribution of the measure, 

25 where the local maxima represent angles which are inserted into the estimated 

mixing matrix A to provide an initial estimate of the estimated mixing matrix 
A. 



25. A computer program product for blind separation of an overcomplete set of mixed 

30 signals as set forth in claim 24, wherein the means for jointly optimizing the source 
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signal estimate matrix S and the estimated mixing matrix A in an iterative manner, 
to generate an optimized source signal estimate matrix S and a final estimated 

A 

mixing matrix A comprises: 

i. means for clustering the mixed signal samples using a geometric constraint; and 

ii. means for evaluating a convergence criteria based on the clustered mixed signal 
samples to determine whether the convergence criteria are met, and if the 
convergence criteria are not met, iteratively adjusting the clustering of the 
mixed signal samples and parameters of the geometric constraint to create a new 
set of clusters until the convergence criteria are met, to provide a final estimated 
mixing matrix A. 

26. A computer program product for blind separation of an overcomplete set of mixed 
signals as set forth in claim 25, wherein the means for transforming the mixed signal 
matrix X into the sparse domain using a transform operator is a Fourier transform 
operator such that the estimated mixing matrix A is represented in the Fourier 
transform, and wherein the means for obtaining a multi-band sparse domain estimate 
of the source signal estimate matrix S using the relationship X = AS + V uses a 
wavelet transform operator to obtain the multi-band sparse domain estimate. 

27. A computer program product for blind separation of an overcomplete set of mixed 
signals as set forth in claim 24, wherein the wherein the means for jointly optimizing 

the source signal estimate matrix S and the estimated mixing matrix A in an 

iterative manner, to generate an optimized source signal estimate matrix S and a final 

estimated mixing matrix A further comprises: 

i. means for obtaining a multi-band sparse domain estimate of the source signal 
estimate matrix S using the relationship X = AS + V ; and 

ii. means for using the adjusted geometric constraint corresponding to the final 
estimated mixing matrix A in each of the bands of the sparse domain for the 
source signal estimate matrix S and determining whether a convergence criteria 
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is met for the source signal estimate matrix S , and if the convergence criteria 
are not met, iteratively adjusting the clustering of the mixed signal samples to 
create a new set of clusters until the convergence criteria are met, to provide a 
final source signal estimate matrix S . 

5 

28. A computer program product for blind separation of an overcomplete set of mixed 
signals as set forth in claim 27, wherein the means for transforming the mixed signal 
matrix X into the sparse domain using a transform operator is a Fourier transform 

A 

operator such that the estimated mixing matrix A is represented in the Fourier 
10 transform, and wherein the means for obtaining a multi-band sparse domain estimate 

of the source signal estimate matrix S using the relationship X = AS + V uses a 
wavelet transform operator to obtain the multi-band sparse domain estimate. 

29. A computer program product for blind separation of an overcomplete set of mixed 

15 signals as set forth in claim 23, wherein the means for generating an initial estimate of 

the estimated mixing matrix A comprises: 

i. means for transforming the mixed signal matrix X into the frequency domain 

using a Fourier operator; 
iL means for using a mutual information criterion to determine a frequency band 
20 within the sparse domain that contains the most information that can be used 

to determine lines of correlation to determine the number of signal sources; 

iii. means for determining a random variable ang = arctan x $ am ^ ? where 

Xj(band) 

xt(band) and Xj(band) represent Fourier values of mixture in the selected 
frequency band, and an optimal threshold ANG for ang, where the optimal 
25 threshold ANG is determined by computing the entropy E(ang, ANG) vs. 

ANG and searching for the optimal value of ANG corresponding to the 
minimum rate of descent of the entropy E(ang, ANG); 

iv. means for recalculating ang based on the optimal threshold ANG; 
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v. means for using a standard peak detection technique to determine the number 
and values of local maxima of a histogram of ang where the local maxima 
represent angles which are inserted into the estimated mixing matrix A to 
provide an initial estimate of the estimated mixing matrix A . 

30. A computer program product for blind separation of an overcomplete set of mixed 
signals as set forth in claim 29, wherein the means for jointly optimizing the source 

signal estimate matrix S and the estimated mixing matrix A in an iterative manner, 

to generate an optimized source signal estimate matrix S and a final estimated 

A. 

mixing matrix A comprises: 

I means for clustering the mixed signal samples in the Fourier domain along the 
lines of correlation with one cluster per source using a straight distance metric 
geometric constraint, with the clusters representing estimates of the Fourier 

domain representation of S , F(S) , where F represents a Fourier domain 
operator ; and 

ii. means for evaluating a convergence criteria, min >x T F(S) , with the 

T * 

convergence criteria, min F(S) , developed from the log likelihood function 
L(F(S) | F(X), A) with the assumption of Laplanicity of source signals in the 
Fourier domain following the probability P(F(S)) = ** ' F( ^ , where 

c T = [1, 1, ...1] is a unit vector, with the convergence criteria, min X,c T F(S) , 
evaluated based on the clustered mixed signal samples to determine whether the 
convergence criteria, min Xc T F(S) , is met, and if the convergence criteria, min 

te T F(S) , is not met, iteratively adjusting the clustering of the mixed signal 
samples and parameters of the geometric constraint to create a new set of 
clusters until the convergence criteria, min Xc r F(S)| , is met, to provide a final 

estimated mixing matrix A. 
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31. A computer program product for blind separation of an overcomplete set of mixed 
signals as set forth in claim 30, wherein the wherein the means for jointly optimizing 
the source signal estimate matrix S and the estimated mixing matrix A in an 

5 iterative manner, to generate an optimized source signal estimate matrix S and a final 

estimated mixing matrix A further comprises: 
i. means for obtaining a multi-band sparse domain estimate of the source signal 

estimate matrix S using the relationship X = AS + V , applied in the Wavelet 
domain; and 

10 ii. means for using the adjusted geometric constraint corresponding to the final 

estimated mixing matrix A in each of the bands of the Wavelet domain for the 
source signal estimate matrix S , W(S) , and determining whether a 

convergence criteria, min Xc T W(S) is met for the source signal estimate 

matrix S , where the convergence criteria, min )x T |w(S)| , is developed from 

15 the log likelihood function L(W(S) | W(X), A) with the assumption of 

Laplanicity of source signals in the Wavelet domain following the probability 

P(W(S)) = V* T l W(S) i f where C T = [1, 1, ...1] is a unit vector, and if the 

convergence criteria is not met, min kc T W(S) , iteratively adjusting the 
clustering of the mixed signal samples to create a new set of clusters until the 
20 convergence criteria, min Xc T W(S)| , is met, to provide a final source signal 

estimate matrix S . 

32. A computer program product for blind separation of an overcomplete set of mixed 
signals as set forth in claim 30, wherein the computer program product is configured 

25 for separating mixed acoustic signals. 
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33. A computer program product for blind separation of an overcomplete set of mixed 
signals as set forth in claim 30, wherein the computer program product is configured 
for separating mixed radio frequency signals. 



5 34. An apparatus for determining a CR bound for an estimated mixing matrix 

A developed in the blind separation of an overcomplete set of mixed signals, the 
apparatus comprising a data processing system including a processor, a memory 
coupled with the processor, an input coupled with the processor, an output coupled 
with the processor, means within the data processing system for generating a CR 

10 bound for the estimated mixing matrix A , and means for generating an output of the 

expected value for the estimation error of associated lines of correlation and for 
providing the output to a user via the output, whereby a CR bound may be developed 
for determining the performance of an estimate of a mixing matrix A developed in 
the blind separation of an overcomplete set of mixed signals in order that a user may 

1 5 know the performance limitations of a blind separation apparatus. 



20 



25 



35. An apparatus for determining a CR bound for an estimated mixing matrix 

A developed in the blind separation of an overcomplete set of mixed signals as set 
forth in claim 34, wherein the means for determining the expected value for the 

estimation error is in the form of E^9 ( - fyj j where 
Eh - 0. J }> r , where: 

EjjPi - 6. J | is an expected value for the estimation error of associated 
lines of correlation; 



6, = arctan 



vil a Miy 



, where a ( = 



a u 

L a 2i. 



,1 = 1, 2, M , and A = A(#) = u(# ; ); 



4 is an estimated value corresponding to an actual value of ; 
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4 is developed from the log likelihood function I(W(S) | W(X), A(#)) 
used for the estimation of the mixing matrix A and the estimation of a 
source signal estimate matrix S ; 

Nis a number of data samples used in the generation of the mixing matrix 
A and the source signal estimate matrix S ; 
"cos(#J 



«(*,.)= 



sin(0,.)J' 



P = 



0 -1 

1 0 



Tis the transpose operator; and 



p 1 - 



°W(V) P^wxv) 



W(V) 



, where (J^ m is a cross correlation of a noise 



set and p is a constant multiplier value. 



36. An apparatus for determining a CR bound for an source signal estimate matrix S 
developed in the blind separation of an overcomplete set of mixed signals, the 
apparatus comprising a data processing system including a processor, a memory 
coupled with the processor, an input coupled with the processor, an output coupled 
with the processor, means within the data processing system for generating a CR 
bound for the source signal estimate matrix S , and means for generating an output of 
the expected value for the estimation error of associated lines of correlation and for 
providing the output to a user via the output, whereby a CR bound may be developed 
for determining the performance of an estimate of a source signal estimate matrix 
S developed in the blind separation of an overcomplete set of mixed signals in order 
that a user may know the performance limitations of a blind separation apparatus. 



37. An apparatus for determining a CR bound for a source signal estimate matrix S 
developed in the blind separation of an overcomplete set of mixed signals as set forth 
in claim 36, wherein the means for determining the expected value for the estimation 
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error is in the form of #fw(S) - W(S)J J 



where £iW(S)-W(S) 



1}>- 



( 



1 P 
P 1 



k T {d)k(9)+l 2 l 



, where 



d v represents a noise level; 
p is a constant multiplier value; 
A is an estimated mixing matrix; 



9- = arctan 



, where a. - 



a u 



J = 1, 2, ..M , and A = A(#) = ufe); 



4 is developed from the log likelihood function Z(W(S) | W(X), A(^)) ; and 
I is an identity matrix. 



38. A method for determining a CR bound for an estimated mixing matrix A developed 
in the blind separation of an overcomplete set of mixed signals, operating on an 
apparatus comprising a data processing system including a processor, a memory 
coupled with the processor, an input coupled with the processor, an output coupled 
with the processor, the method comprising the steps of generating a CR bound for the 
estimated mixing matrix A , and generating an output of the expected value for the 
estimation error of associated lines of correlation and for providing the output to a 
user via the output, whereby a CR bound may be developed for determining the 
performance of an estimate of a mixing matrix A developed in the blind separation of 
an overcomplete set of mixed signals in order that a user may know the performance 
limitations of a blind separation apparatus. 



39. A method for determining a CR bound for an estimated mixing matrix A developed 
in the blind separation of an overcomplete set of mixed signals as set forth in claim 
38, wherein in the step of determining the expected value for the estimation error, the 
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expected value for estimation error is in the form ofi?^ - 0. J ] where 



- , where: 



2iVu r (^.)p r R^ ) pu(^) ; 
E^9 i - 0. J | is an expected value for the estimation error of associated 



lines of correlation; 



0: = arctan 



, where a. = 



L fl 2f 



,z = 1, 2, ...M , and A = A(0) = u(#.); 



6 X is an estimated value corresponding to an actual value of 0 i ; 
% is developed from the log likelihood function i(W(S) | W(X), A(#)) 
used for the estimation of the mixing matrix A and the estimation of a 
source signal estimate matrix S ; 

N is a number of data samples used in the generation of the mixing matrix 

A and the source signal estimate matrix S ; 

r cos(0,)~ 
"_sin(^)J ; 



P = 



0 -1 

1 o 



Tis the transpose operator; and 



pi _ 

W{V) ~ 



2 2 

°W(V) P a w(V) 

2 2 

set and /? is a constant multiplier value 



, where is a cross correlation of a noise 



40. A method for determining a CR bound for an source signal estimate matrix S 

developed in the blind separation of an overcomplete set of mixed signals, operated in 
an apparatus comprising a data processing system including a processor, a memory 
coupled with the processor, an input coupled with the processor, an output coupled 
with the processor, the method comprising the steps of generating a CR bound for the 

source signal estimate matrix S , and generating an output of the expected value for 
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the estimation error of associated lines of correlation and for providing the output to a 
user via the output, whereby a CR bound may be developed for determining the 
performance of an estimate of a source signal estimate matrix S developed in the 
blind separation of an overcomplete set of mixed signals in order that a user may 
5 know the performance limitations of a blind separation apparatus. 



10 



15 



41. A method of determining a CR bound for a source signal estimate matrix S 

developed in the blind separation of an overcomplete set of mixed signals as set forth 
in claim 40, wherein the in the step of determining the expected value for the 
estimation error, the expected value for the estimation error is in the form 



of £|W(S) - W(S)) 2 } where£f\V(S) - W(S)J }: 



1 P 
P 1 



k T (e)k{e)+x 2 i 



V 1 



where 

.2 



a v represents a noise level; 
p is a constant multiplier value; 
A is an estimated mixing matrix; 



9 ; = arctan 



Vll a *ll>> 



, where a . = 



a u 



L a 2i. 



,i = 1, 2, ...M , and A = A(0) = ufe); 



4 is developed from the log likelihood function i(W(S) | W(X), A(fl)) ; and 
I is an identity matrix. 



20 42. A computer program product for determining a CR bound for an estimated mixing 
matrix A developed in the blind separation of an overcomplete set of mixed signals, 
the computer program product being written onto a medium readable on a data 
processing system including a processor, a memory coupled with the processor, an 
input coupled with the processor, an output coupled with the processor, with the 

25 computer program product comprising means for generating a CR bound for the 

estimated mixing matrix A , and means for generating an output of the expected 

value for the estimation error of associated lines of correlation and for providing the 
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output to a user via the output, whereby a CR bound may be developed for 
determining the performance of an estimate of a mixing matrix A developed in the 
blind separation of an overcomplete set of mixed signals in order that a user may 
know the performance limitations of a blind separation apparatus. 

43. A computer program product for determining a CR bound for an estimated mixing 
matrix A developed in the blind separation of an overcomplete set of mixed signals as 
set forth in claim 42, wherein the means for determining the expected value for the 

estimation error determines an estimation error by calculating Em - 0J j where 




2Mi^fe)p r R-V ) pufe) 



, where: 



EjPi -0. J j is an expected value for the estimation error of associated 
lines of correlation; 




0 ( = arctan ^ , where a, = u 9 i = 1, 2, ...M , and A = A(#) = u(^); 



0 i is an estimated value corresponding to an actual value of 0. ; 
4 is developed from the log likelihood function Z(W(S) | W(X), A(0)) 
used for the estimation of the mixing matrix A and the estimation of a 
source signal estimate matrix S ; 

N is a number of data samples used in the generation of the mixing matrix 

A A 

A and the source signal estimate matrix S ; 




0 -1 



P = 



1 0 



Tis the transpose operator; and 
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W(V) 



_2 

° W(V) 
.2 



P°V(V) 

2 



P a vt<y) " woo 
set and p is a constant multiplier value. 



, where is a cross correlation of a noise 



44. A computer program product for determining a CR bound for an source signal 

A 

5 estimate matrix S developed in the blind separation of an overcomplete set of mixed 

signals, the computer program product being written onto a medium readable on a 
data processing system including a processor, a memory coupled with the processor, 
an input coupled with the processor, an output coupled with the processor, with the 
computer program product comprising means for generating a CR bound for the 
10 source signal estimate matrix S , and means for generating an output of the expected 
value for the estimation error of associated lines of correlation and for providing the 
output to a user via the output, whereby a CR bound may be developed for 
determining the performance of an estimate of a source signal estimate matrix 

S developed in the blind separation of an overcomplete set of mixed signals in order 
15 that a user may know the performance limitations of a blind separation apparatus. 



20 



25 



45. A computer program product for determining a CR bound for a source signal estimate 

matrix S developed in the blind separation of an overcomplete set of mixed signals as 
set forth in claim 44, wherein the means for determining the expected value for the 

estimation error determines an estimation error by calculating Js|w(S) - W(S)) 2 } 



where ^|w(S) - W(S)) 2 j> 



1 P 
P 1 



v-l 



k T {e)k{e)+z 2 \ 



, where 



<j v represents a noise level; 
p is a constant multiplier value; 
A is an estimated mixing matrix; 



0, = arctan 



vn a iiiy 



, where a, = 



a u 
L a 2i. 



,i = 1, 2, .. M , and A = A(#) = ufa ); 
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% is developed from the log likelihood function I(W(S) | W(X), A(#)) ; and 
I is an identity matrix. 
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